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ABSTRACT 


Markov chain is one of the techniques used in operations research with 
possibilities view that managers in organizational decision making (industrial 
and commercial) use it. Markov processes arise in probability and statistics in 
one of two ways. Markov process is a tool to predict that it can make logical 
and accurate decisions about various aspects of management in the future. 
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1. INTRODUCTION 

Modern probability theory studies change process for which the knowledge of 
previous outcomes influences predictions for future experiments. In principle, 
when we observe a sequence of chance experiment, all of the past outcomes 
could influence our predictions for the next experiment. For example, this 
should be the case in predicting a student's grades on a sequence of exams in a 
course. But to allow this much generality would make it very difficult to prove 
general results. 

In 1907, A.A. Markov began the study of an important new type of chance 
process. In this process, the outcome of a given experiment can affect the 
outcome of the next experiment. 

2. SOME DEFINITIONS AND NOTATIONS 
2.1 Stochastic Process 

A stochastic process {X t ,t e T}is a collection of random variables. 
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The index t represents time and we refer X t as the state of 
the stochastic process at time t. The set T is called the index 
set of the stochastic process. The index t is after interpreted 
as time and as a result, as refer X(t) as the state of the 
process at time. 

It T = {0,1,2, .}, then the stochastic process is said to be 

discrete-time process. It T is an interval of the real line, then 
the stochastic process is said to be a continuous-time 
process. For instance |X n ,n = 0,l,2, .}is a discrete¬ 

time process indexed by the non-negative integers; while 
{X t , t > 0} is a continuous-time stochastic process indexed 

by the non-negative real numbers Let {X n , n = 0,1,2,.} 

be a discrete-time stochastic process. If X n =i, then the 
process is said to be state i at time n. A stochastic process 
|X n ,n = 0,l,2, .}is called a Markov chain if 

P { X n + 1 =j\ X n =i ’ X n-l =tp. ’ X > =h X 0 = *0 } = P ij 

This Equation may be interpreted as stating that; for a 
Markov chain, the conditional distribution of any future state 

X n+ i given in the past states Xo, Xi,.X n -i and the present state 

X n , is independent of the past states and depends only on the 
present state. 

The value Pij denotes the probability that the Markov chain, 
whenever in state i (the current state) moves next (one unit 
of time later) into state j and is referred to as a one-step 


transition probability. The transition probabilities are 
collected into the one-step transition probability matrix. It is 
denoted by P. This is, 
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Since Probabilities are non-negative and since the process 
must take a transition into some state, we have that 

0) P tj >0,i,j>0 

f P t ; = V= 0. 1. 2.. 

GO J-o 

A state of a Markov chain is called absorbing if it is 
impossible to leave it. A Markov chain is absorbing if it has at 
least one absorbing state and if from every state it is possible 
to go to an absorbing state (not necessarily in one step). 
Markov chains have many applications as statistical models 
of real-world processes. 

2.2 Example (beauty and intelligence) 

Albert Einstein was born on born March 14th, 1879 in 
Germany. He died in April 18th, 1955. Marilyn Monroe was 
an American actress and model. She was born on 1st June of 
1926 in Los Angeles, United States. She died in August 5th, 
1962. 
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At a dinner party, Einstein and Marilyn sat next to each 
other. After a few flutes of champagne, she cooked in his 
attentive ear: "I want to have your child. With my looks and 
your brains, it will be a perfect child!" Einstein replied: "But 
what if it has my looks and your brains?" 

According to this quote, we can construct Markov Model. For 
example: 

Marilyn Monroe 



Ignoramus 

beauty 

Albert Einstein 

Intelligence 

O 

0.5' 




,0.5 

0.5 y 


The child will be perfect child because of the combination of 
beauty and intelligence or the child will be ugly and 
ignoramus. For more details of genus model I discussed in 
next example. 

2.3 Example (Simple Mendelian inheritance) 

A certain trait is determined by a specific pair of genes, each 
of which may be two types, say G and g. 

One individual may have: 

> GG combination (dominant) 

> Gg or gG, considered equivalent genetically (hybrid) 

> gg combination (recessive) 

In sexual reproduction, offspring inherit one gene of the pair 
from each parent. 

2.3.1 Basic assumption of Mendelian genetics 

Genes inherited from each parent are selected at random, 
independently of each other. This determines probability of 
occurrence of each type of offspring. The offspring 

> of two GG parents must be GG, 

> of two gg parents must be gg, 

> of one GG and one gg parent must be Gg, 

> Other cases must be examined in more detail. 


2.3.2 Gg and Gg parents 



Offspring has probability 

1 

> —of being GG 

4 


> —of being Gg 


> —of being gg 

4 


2.3.3 GG and Gg parents 



Parents 


Offspring 


> 

> 


1 

— of being GG 
1 

— of being Gg 


2.3.4 gg and Gg parents 



of being Gg 


of being gg 


Offspring 


Let pi(n + 1) be the probability that state Si, 1 < i < r, occurs 
on(n + l) th repetition of the experiment. 


There are r ways to be in state Si at step n + 1: 

1. Step n is Si. Probability of getting Si on n th step is pi(n), 
and Probability of having Si after Si is pii. Therefore, by 
multiplication Principle, P (Si |Si) = piipi (n). 

2. We get S 2 on step n and Si on step (n + 1). 

Then P (Si |S2) =p 2 iP 2 (n). 


r. Probability of occurrence of Si at step n + 1 if Sr at step n is 
P (Si I Sr) = PriPr(n). 


Therefore, pj (n + 1) is sum of all these, 
Pi (n + l) = P(Si|Si) + - + P(Si|S r ) 

= PliPi (n) + • + PriPr(n) 


2.3.5 General case 

Let pi(n) be the probability that the state Si will occur on the 
n th repetition of the experiment, 1 < i < r. 

Since one the states Si must occur on the n th repetition, 
Pi(n) + p 2 (n) + • • • + p r (n) = 1. 


Therefore, 

pi(n + 1) = piipi(n) + p 2 ip 2 (n) + • • • + p r ip r (n) 
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p k (n + 1] = pikPi(n) + p 2 kP 2 (n] + • • • + p r kPr(n) (1] 


Pr(n + 1 ] = PlrPl(n) + P2rP2(n] + • • • + p rr pr(n) 

In matrix form 

p(n + 1) = p(n)P, n = 1, 2, 3,... (2] 

Where p(n) = (pi(n), p 2 (n),..., p r (n)} is a (row) probability 
vector and P = (pij) is a r x r transition matrix, 


r Pu 

Pn •• 

- P\A 
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... P 2r 

yPr 1 

Pr 2 ” 

- Pn , 


For our genetic model.. 

Consider a process of continued mating. 

> Start with an individual of known or unknown genetic 
character and mate it with a hybrid. 

> Assume that there is at least one offspring; choose one of 
them at random and mate it with a hybrid. 

> Repeat this process through a number of generations. 

The genetic type of the chosen offspring in successive 
generations can be represented by a Markov chain, with 
states GG, Gg and gg. 

So there are 3 possible states Si = GG, S2 =Gg and S3 = gg. 

So, what we have is 


[pi(n + 1),..., p r (n + 

1 )] = 




r Pn 

Pn •• 

" PlT 

[pi[np r [n )] 
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P22 
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It is easy to check that this gives the same expression as (1) 
We have 



GG 

Gg 

gg 


GG 
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gg 
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The transition probabilities are 


0.5 

0.5 

0 ) 
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0.5 

0.25 

0 

0.5 
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The two step transition matrix is 
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v 0.125 
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This result showed the fact that when the dominant gene and 
the recessive gene mixed the different types, the dominant 
gene reappeared in second generation and later. 

3. CONCLUSION 

This paper aims to present the genetic science from the 
mathematical point of view. To do research more from this 
paper, a new, well-qualified genetic one can be produced in 
combination with two existing genetics. In accordance with 
calculating or speculating the genetic probability from the 
mathematical aspect, it may be the logical impossibility in 
real world. 
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